Data Engineer

About

Description

RMB is South Africa’s leading employer in Financial Services for 2023, driven by a proud heritage and strong ethics. The Data Provisioning team is responsible for providing timely and secure access to data, managing data assets, and ensuring they are available to the right users or systems. As a Data Engineer, you will develop and support the design, automation, testing, and administration of the Data Engineering service. This role requires experience with Hadoop, Relational Database Management Systems, and ETL, and involves supporting the data engineering community with a streaming platform for data integration.

Responsibilities

• Develop and deploy data applications
• Design and implement infrastructure tooling and horizontal frameworks
• Create data ingestion pipelines between legacy data warehouses and the big data stack
• Automate backend workflows
• Build and maintain backend services
• Maintain and enhance applications backed by Big Data computation applications

Qualifications

• Relevant Degree in Computer Science, Engineering, IT, Mathematics, or a related field
• Minimum 3 years of experience with ETL tools like Ab Initio and Informatica
• Ability to configure repository projects using Ab Initio EME for creating a common development environment
• Knowledge of Control M to automate and schedule jobs
• Expertise in Informatica PowerCenter and EDC
• Proficiency in programming languages such as SQL, XTML, Java, and Python
• Experience with data platforms like Oracle, Teradata, Hadoop, and SQL
• Worked on Big Data platforms (Vanilla Hadoop, Cloudera, or Hortonworks)
• Knowledge of large data architectures (data warehouses, lakes, meshes)
• Experience with Scala or other functional languages
• Familiarity with Apache Hadoop, Spark, Hive, HDFS, and ZooKeeper
• Experience with reporting tools like PowerBi

Application instructions:

• To apply, simply click the Apply button.